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1.  (U)  Fnclosure  (1)  is  concerned  with  the  ASK  fixed  wing  project  as 
tasked  by  CNO  and  is  included  in  COMASKFOlU’AC’s  VASSF.L  (Validation  of  ASW 
Sub-Systems  Effectiveness  Levels)  series.  Hie  report  is~being  forwarded 
to  CCMASWFORI ANT ,  acting  for  CINCIANTFLT ,  for  inclusion  in  the  FTXKEX 
evaluation  project  as  appropriate. 

2.  (U)  Tlie  analysis  reported  in  enclosure  (1)  develops  a  methodology 
for  comparing  propagation  loss  predictions  with  loss  measurements.  This 
technique  is  then  applied  to  loss  measurements  obtained  during  the  VASSEL 
XV  exercise  and  predictions  made  by  Fleet  Numerical  heather  Central. 
Typically,  measured  losses  and  predictions  have  been  compared  by  visually 
observing  the  correspondence  of  loss  versus  range  plots.  When,  however, 
repeated  measurements  are  made,  as  in  VASSEL  XV,  information  becomes 
available  on  the  variability  of  the  measurements.  Wide  variation  in  the 
measured  data  necessarily  makes  visual  interpretation  more  difficult  and 
less  certain,  thus,  the  statistical  error  analysis  tecliniques  applied  in 
enclosure  (1)  provide  more  valid  assessment  of  the  prediction  accuracy. 
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Mathematical  models  which  accurately  predict  underwater  sound  propagation 
loss  fields  surrounding  a  given  sound  source  would  be  extremely  valuable  to 
the  Navy.  Several  such  models  have  been  developed,  but  their  accuracy  has  not 
been  established.  Project  VASSEL  XVI  intends  to  compare  the  losses  predicted 
by  a  number  of  models  to  those  observed  in  at-sea  experiments. 

The  ultimate  goal  of  the  project  is  not  the  selection  of  one  superior 
model;  rather  it  is  to  investigate  the  usefulness  of  several  models,  each 
of  which  nav  be  applicable  for  different  purposes  under  various  conditions. 

This  report  is  the  first  of  the  VASSEL  XVI  series  and  presents  an  analytic 
comparison  between  propagation  loss  data  obtained  during  the  VASSEL  XV/FIXWEX 
exercise  and  losses  predicted  by  a  model  developed  and  used  by  the  Fleet 
Numerical  '.feather  Central  (FLENUMWEACEN) . 

Regardless  of  the  degree  of  correspondence  found  between  the  nodel  and  the 
data,  the  model  will  not  be  considered  validated  for  general  use.  The  propa¬ 
gation  loss  measurements  were  made  under  controlled  conditions  but  the  geographical 
area  and  environmental  conditions  were  extremely  limited  throughout  the  experiment. 
No  information  was  obtained  as  to  the  applicability  of  the  model  under  any  other 
circumstance  or  in  other  areas. 

This  report  is  intended  to: 

1.  Provide  FLENUMWEACEN  with  a  quantitative  assessment  of  model 
performance  against  a  set  of  high  quality  experimental  data. 

2.  Provide  information  on  model  effectiveness  to  potential  users 
of  propagation  loss  predictions. 

3.  Indicate  to  those  involved  in  designing  at-sea  experiments  tire 
nature  of  seme  unresolved  problems  which  might  warrant  investigation. 
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This  report  develops  a  pcthcdclojy  for  analytical 2y  Caspar iivj  underwater  sound 
propagation  loss  measurements  with  predictions  made  by  a  propagation  loss  model. 
Tlie  netJioc  is  employed.  to  caniwre  measurements  during  an  at  sea  exg.crij'cnt  (VESSEL 
XV/ri5C-.!EX)  with  predictions  made  by  Tlcct  i.'irserical  '.fentiier  Central's  pro;xaqation 
loss  model.  Experimental  error  and  model  error  ccr>i;;ononts  arc  separated  and  their 
distributions  arc  analyzed.  Ti;e  influence  of  local  hotter,  topography  on  the 
exi'crimental  data  and  model  predictions  is  examined. 
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I.  INTRODUCTION 

Mathematical  models  which  accurately  predict  underwater  sound  propagation 
loss  fields  surrounding  a  given  sound  source  would  be  extremely  valuable  to 
the  Navy.  Several  such  models  have  been  developed,  but  their  accuracy  has  not 
been  established.  Project  VASSEL  XVI  intends  to  compare  the  losses  predicted 
by  a  number  of  models  to  those  observed  in  at-sea  experiments. 

The  ultimate  goal  of  the  project  is  not  the  selection  of  one  superior 
model;  rather  it  is  to  investigate  the  usefulness  of  several  models,  each 
of  which  may  be  applicable  for  different  purposes  under  various  conditions. 

This  report  is  the  first  of  the  VASSEL  XVI  series  and  presents  an  analytic 
comparison  between  propagation  loss  data  obtained  during  the  VASSEL  XV/FIXWEX 
exercise  and  losses  predicted  by  a  model  developed  and  used  by  the  Fleet 
Numerical  '.leather  Central  (FLENUMWEASEN) . 

Regardless  of  the  degree  of  correspondence  found  between  the  model  and  the 
data,  the  model  will  not  be  considered  validated  for  general  use.  The  propa¬ 
gation  loss  measurements  were  made  under  controlled  conditions  but  the  geographical 
area  and  environmental  conditions  were  extremely  limited  throughout  the  experiment. 
No  information  was  obtained  as  to  the  applicability  of  the  model  under  any  other 
circumstance  or  in  other  areas. 

This  report  is  intended  to: 

1.  Provide  FI£NLMWEACEN  with  a  quantitative  assessment  of  model 
performance  against  a  set  of  high  quality  experimental  data. 

2.  Provide  information  on  model  effectiveness  to  potential  users 
of  propagation  loss  predictions. 

3.  Indicate  to  those  involved  in  designing  at-sea  experiments  the 
nature  of  seme  unresolved  problems  which  might  warrant  investigation. 
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II. 


METHODOLOGY 


A.  GENE PAL.  The  various  processes  of  gathering  data  at  sea,  performing 
the  acoustic  processing,  developing  the  propagation  loss  model,  and  comparing 
results  were  accomplished  under  several  different  projects;  VASSEL  XVI  only 
involves  the  comparison.  A  complete  explanation  of  the  comparison  requires 
first  a  description  of  how  the  data  were  obtained  and  seme  explanation  of  how 
the  model  operates  even  though  this  work  was  done  by  others  and  is  not  part 
of  the  present  study.  Consequently,  this  section  is  sub-divided  to  provide 
brief  descriptions  of  associated  work  done  previously  and  seme  of  the  'work 
done  during  this  project. 

B.  DESCRIPTION  OF  VASSEL  XV/FIX.'EX  EXERCISE. 

While  a  detailed  description  of  the  VASSEL  XV  exercise  is  presented 
in  a  separate  report,  a  summary  of  the  exercise  is  provided  here  as  back¬ 
ground. 


VASSEL  XV  was  a  joint  effort  of  NADC,  COMASWPORPAC  and  LTV  Research 
Center.  It  was  conducted  during  the  period  28  April  to  1  May  1968  in  an 
area  southwest  of  Oahu,  centered  at  approximately  2  On,  161°W.  The  exercise 
involved  an  array  of  eight  sonobuoys,  the  submarine  USS  SARGO  (SSN-583) ,  a 
low  frequency  sound  projector  tewed  by  the  USS  RADFORD  (CD-446) ,  and  monitoring 
aircraft  frem  VP-28.  The  geometry  of  the  array  and  the  participants'  tracks 
are  shown  in  Figure  1. 

Five  similar  events  were  conducted;  each  consisting  of  one  pass  by 
RADFORD  towing  the  projector,  and  two  passes  by  SARGO.  A  "pass11  oonsisted  of 
a  transit  between  buoys  C  and  F  (Figure  1) .  Every  attempt  was  made  to  maintain 
constant  geometry  throughout  the  exercise,  with  one  exception.  In  four  of  the 
five  events  the  projector  was  towed  at  300  feet  depth  and  the  submarine  was  at 
400  feet  depth.  In  the  fifth  event  both  submarine  and  projector  were  at  200  feet. 

Acoustic  data  were  recorded  by  VP  aircraft  using  calibrated  AN/SSQ-48 
XN-2  sonobuoys  and  specially  configured  and  calibrated  Absolute  Sound  Pressure 
level  (ASPL)  panels.  All  sonobuoy  signals  were  recorded  continuously  on  magnetic 
tape. 


The  source  levels  of  the  submarine  and  the  projector  were  obtained  in 
subsequent  measurements  using  the  schooner  FIESTA  and  the  standard  Navy  PQ'!-2 
noise  measuring  set.  The  projector  was  found  to  be  omnidirectional  with  a 
source  level  of  89  db//  1  pbar  at  125  Hz. 


Detailed  navigation  logs  were  kept  by  all  participants  during  the 
experiment.  Local  time  standard,  WWVN,  was  recorded  on  the  magnetic  tapes 
simultaneously  with  the  sonobuoy  signals  to  enable  correlation  with  source 
position. 


C.  ACOUSTIC  DATA  PROCESSING 


Both  submarine  noise  and  projector  signals  were  recorded  in  the  air¬ 
craft.  Propagation  loss  measurements,  hewever,  were  taken  only  frem  the 
projector  runs.  This  section  briefly  describes  the  processing  of  projector 
recordings,  by  which  measures  of  propagation  loss  were  obtained. 
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The  processing  of  recorded  signals  was  done  by  the  Ling-Tenco-Vought 
Research  Center  as  a  part  of  the  V7VSSEL  XV  project  and  a  ccrplete  description 
of  the  equipcent  and  methods  used  appears  in  that  proiect  report. 

The  basic  objective  of  the  recorded  signal  analysis  was  to  certain 
measurements  of  the  propagation  loss  as  a  function  of  range  from  the  source. 

The  results  of  the  analysis  consist  of  two  series  of  meters,  each  muter 
being  the  loss  observed  in  a  particular  range  interval  from  the  source.  In 
one  series  the  meters  are  one  minute  averages  and  in  the  other  the  nutters 
are  five  minute  moving  window  type  averages.  Incident  to  determining  propa¬ 
gation  loss  the  signal  to  noise  ratio  in  the  signal  band  and  the  noise  level 
in  adjacent  frequency  bands  were  also  obtained. 

The  processing  procedure  used  both  analog  and  digital  techniques. 

The  raw  data  tapes  were  time  ccrpressed,  edited,  filtered  and  re-recorded. 

The  edited  tapes  contained  one  channel  of  signal  plus  noise,  two  channels 
of  noise  in  frequency  bands  adjacent  to  125  Hz  and  one  channel  of  tire 
markers  and  event  identification.  The  signal  band  was  2  Hz  wide  and  the 
noise  bands  were  12.5  Hz  wide,  centered  at  110  Hz  and  140  Hz.  The  output 
of  the  edited  tapes  was  heterodyned  to  base  band,  detected  and  dimpled  by  an 
11  bit  analog  to  digital  converter.  The  resulting  power  values  for  signal 
plus  noise  and  two  noise  channels  were  then  recorded  on  digital  tapes. 

The  digital  records  were  read  into  an  ISM  360/50  ccrputer  which 
performed  a  number  of  adjustments,  such  as: 

1.  Ctarrpensation  for  losses  in  analog  processing. 

2.  Compensation  for  loss  rate  as  a  function  of  frequency  (4.5  db/octave) . 

Compensation  for  attenuation  changes  in  receiver  channels. 

.ata  were  then  transformed  to  1  Hz  reference  levels  and  averaged 

- .a™*  five  minute  "moving  window"  periods.  The  signal  to  noise  ratio 

in  the  signal  band  was  calculated  and  finally  the  propagation  loss  was  computed 
from: 

P.L.  =  Source  level  (89  do)  -  Signal  level  [(S-hN)Q  -  n^b] 
where: 

(S+M)g  =  Signal  plus  noise  power  in  signal  band  B 
=  Noise  power  in  1  Hz  band 

B  =  Signal  band  width  (1.25  Hz) 

No  calculations  of  propagation  loss  were  made  if  the  signal  to  noise  ratio 
was  less  than  3'  db. 

The  propagation  losses  were  also  averaged  over  one  and  five  minute 
moving  windows  and  final  output  tapes  were  recorded.  They  contain: 

L  One  and  five  minute  imoise  averages  at  each  sormebuoy. 

2.  Propagation  loss  about  each  buoy  as  a  function  of  range  and 
averaged  for  one  and  five  minutes. 
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3.  Signal  to  noise  ratio  as  a  function  of  range  about  each  buoy.  Oily 
the  five-minute  averaged  data  were  available  for  VASSEL  XVI,  so  the  remainder  of 
the  report  deals  with  five  minute  averages  only. 

D.  PROPAGATION  LOSS  MODEL 

The  propagation  loss  model  now  in  use  at  ET£NIM\'EACEJ  is  the  most 
recent  and  most  comprehensive  of  a  series  that  have  been  developed  by  that 
ccrmand.  The  present  version  was  put  into  general  use  in  October  1968. 

The  basic  objective  of  the  model  is  to  calculate  the  scund  propagation 
loss  at  points  in  a  field  about  a  given  source.  It  consists  of  a  computer 
program  which  accepts  certain  inputs  concerning  the  situation  to  be  modeled, 
performs  ray  tracing  and  loss  calculations,  and  tabulates  the  results  as  propa¬ 
gation  loss  vs.  range  frcm  source. 

For  purposes  of  description,  the  propagation  loss  program  may  be 
conveniently  broken  into  a  mm!«r  of  sequential  steps.  The  first  step  is  to 
accept  input  data  concerning  the  geometry  of  the  situation  and  the  characteristics 
of  the  source,  the  median  and  the  boundaries.  Having  this  data  the  program 
then  traces  out  the  geometrical  paths  followed  by  approximately  100  representative 
rays  emanating  frcm  the  source.  The  angular  spacing  of  rays  traced  varies  around 
the  source;  the  spacing  normally  used  is  shewn  in  Table  1. 


ANGLE  INTERVAL 

SPACING 

0.0  -  14.75  (degrees) 

0.25  (degrees) 

15.0  -  39.00 

1.00 

40.0  -  56.00 

2.00 

58.0  -  88,00 

5.00 

0  degrees  =  horizontal  ray 
+  90  degrees  =  vertical  ray 

RAY  ANGLE  INTERVALS  USED  BY  FLENUMWEACEN 

TABLE  1 


At  any  point  on  one  of  the  rays,  the  propagation  less  from  the  source  to 
that  point  along  the  ray  may  be  calculated  as  the  result  of  absorption,  spreading, 
and  reflection  losses,  ltie  program  computes  and  tabulates  these  losses  at 
intervals  along  each  of  the  rays. 

At  this  stage  the  program  has  traced  rays  and  computed  losses  along 
;  these  rays.  This  does  not  me;m,  however,  that  the  total  propagation  loss  between 
the  source  and  all  points  in  the  field  is  known.  For  any  point  in  the  field 
about  the  source  there  are  several  paths  by  which  sound  may  propagate  frcm  the 
source  to  the  point.  There  is  generally  one  direct  path,  one  surface  reflection, 
one  bottom  reflection  and  combinations  of  multiple  surface  and  bottom  reflections 
which  connect  the  source  and  the  point.  The  total  loss  between  the  source  and 
the  point  is  a  comoination  of  the  losses  along  each  of  the  various  acoustic  paths . 
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Most  points  picked  at  randan  in  the  loss  field  do  not  lie  on  any  of  the 
representative  rays  which  were  traced  out,  but  lie  between  a  pair  of  direct 
rays,  a  pair  of  surface  reflected  rays,  a  pair  of  bottan  reflected  rays,  and 
so  on.  To  determine  the  loss  along  an  untraced  direct  ray,  the  program 
interpolates  between  losses  found  for  points  on  the  two  adjacent  direct  rays. 
Interpolation  is  similarly  used  to  get  losses  along  the  reflected  rays.  When 
the  losses  along  the  various  paths  have  been  determined  a  total  loss  for  the 
given  point  is  calculated.  This  total  loss  is  less  tlian  the  loss  along  any 
single  path. 

The  general  objective  of  the  program  is  to  tabulate  the  predicted  loss 
at  a  receiver  at  a  given  depth  as  a  function  of  horizontal  range  from  the  source. 
For  example ,  if  the  loss  at  half-mile  intervals  along  the  100  foot  depth  level 
is  desired,  the  program  selects  points  a  half-mile  apart  at  100  foot  depth  and 
ccmputes  the  total  loss  from  the  source  to  each  point. 

The  above  program  is  analagous  to  having  a  sound  projector  in  a  fixed 
location  and  measuring  the  loss  to  a  receiver  which  is  towed  along  at  100  feet. 

A  minor  problem  arises  when  the  program  results  are  to  be  compared  to  measure¬ 
ments  taken  with  a  fixed  receiver  and  a  moving  source.  Initially,  it  appears 
that  a  complete  new  ray  trace  must  be  made  for  each  position  of  the  source  as 
it  is  moved  along.  This  difficulty  is  avoided,  however,  by  reversing  the 
roles  of  the  source  and  receiver  in  the  model.  In  other  words,  if  the 
experiment  requires  a  fixed  receiver  and  a  moving  source,  the  oomputer  program 
is  run  as  if  the  source  were  in  the  receivers  position  and  vice  versa.  This 
role  reversal  avoids  having  to  run  multiple  ray  traces  for  each  new  source 
position.  Justification  for  this  procedure  is  the  widely  used  reciprocity 
relation  which  holds  that,  given  a  source  and  receiver  at  fixed  points,  an 
identical  transmission  loss  will  be  observed  between  the  two  points  if  the 
source  and  receiver  arc  interchanged. 

When  the  model  is  to  be  used  to  predict  losses  for  a  specific  area 
and  time,  it  must  receive  certain  information  concerning  the  circumstances 
to  be  simulated.  The  model  requires  the  following  input  data: 

•  Source  and  receiver  depths. 

•  Source  frequency. 

•  Sound  velocity  profiles  (SVP’s) ,  surface  to  bottom. 

•  Bottom  depth  and  topography. 

•  Bottan  roughness  and  reflectivity. 

•  Ray  spacing  to  be  used. 

Prior  to  the  input  of  the  SVP's,each  is  fitted  to  a  cubic  curve.  The 
result  is  a  smooth  curve  with  no  discontinuities  in  slope,  thereby  eliminating 
false  caustics  which  would  occur  at  discontinuity  points  in  a  series  of  linear 
segments.  If  the  dimensions  of  the  area  of  interest  are  large  enough  to  include 
two  or  more  differing  water  columns,  an  appropriate  velocity  profile  is  introduced 
for  each,  and  linear  interpolation  between  profiles  is  used  to  obtain  a  continuous 


fi el J.  If  in  drops  have  been  Made  in  the  area  to  be  simulated,  the  velocity 
profiles  arc  commuted  using  the  !5T  inlonnation.  Salinities  arc  obtained 
from  climatological  charts.  For  dcpJis  beyond  the  !JT  data  climatology  is 
used  to  extend  the  profile  to  the  sea  floor. 

bottom  depth  and  topography  are  obtained  either  from  measurement 
during  experiments  or  from  the  most  accurate  available  charts  of  the  area, 
(icnerallv,  the  depth  at  each  half-mile  interval  is  specified  to  the  model, 
i'cpth  data  used  during  the  VASSII,  XVI  model  runs  arc  from  charts  of  the  area. 

bottom  roughness  classes  arc  obtained  from  Marine  Geophysical  Survey 
kata  where  .available.  The  sea  floor  is  divided  into  five  roughness  classes 
and  bottom  losses  as  a  function  of  the  frequency  arc  obtained,  for  each,  class  by 
analysis  of  the  MGS  data. 

The  program  output  consists  of  three  parts: 

1.  A  specification  section  which  identifies  the  run,  tlie  source  and 
receiver  depths,  and  the  frequency. 

2.  A  tabulation  of  projiagation  loss  at  ever/  horizontal  half-mile 
range  from  0  to  125  miles.  The  losses  are  shown  to  the  nearest  .1  db. 

3.  A  oraphic  plot  of  the  tabulated  data  showing  the  losses  to  the 
nearest  1  db  every  one  nautical  mile  from  0  to  125  miles. 

The  computer  time  used  for  elements  of  the  program  is  as  follows : 

Hay  Trace  -  3.5  hours  [)er  run  (approximately) 

Propagation  Loss  -  .2  hours  per  run  (approximately) 

E.  GEOMETRY  OF  EXPERIMENT  AND  MODEL 


The  at-sea  experiment  was  conducted  with  a  particular  geometrical 
relationship  between  tne  buoys,  tne  moving  source,  and  tlie  bottom  terrain. 

It  was  important  that  the  model  runs  be  based  on  the  same  geometry.  In 
setting  up  the  model,  the  first  step,  as  explained  in  Section  D,  was  to 
reverse  the  roles  of  the  source  and  receiver,  since  the  source  was  the  moving 
element.  Thus,  the  program  regarded  each  buoy  as  a  source  and  predicted  tlie 
propagation  loss  that  should  be  observed  by  a  receiver  towed  along  tlie 
projector's  track. 

Figure  2  is  a  schematic  vertical  section  of  the  experiment.  Tlie  diagram 
is  out  of  scale  to  emphasize  the  influence  of  the  irregular  bottom  on  the 
sound  propagation  paths.  The  buoys  are  designated  A  thru  11.  The  line  0-P 
represents  the  path  over  which  the  projector  was  towed.  Point  0,  directly 
below  buoy  C,  and  point  P,  directly  belcw  buoy  F,  are  40  miles  apart. 

Examination  of  the  signal  paths  to  each  buoy  revealed  that  signals 
arriving  at  buoy  A  originated  75  to  115  miles  away,  signals  at  buoy  B 
originated  35  to  75  miles  away  and  signals  received  at  buoy  C  originated 
0  to  40  miles  away.  Data  from  buoys  A,  B,  and  C  were  therefore  three 
independent,  contiguous  sets  that  covered  an  overall  range  of  0  to  115  miles 
with  one  overlap  in  the  35  to  40  mile  range.  Similar,  but  not  identical, 
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results  were  obtained  Cor  buoys  F,  (1  and  H. 

It  is  important  to  keep  the  results  from  buoys  A  and  i  separate, 
even  though  they  measure  losses  over  the  same  range  interval .  Since  the 
bottom  terrain  was  quite  different,  about  A  and  II,  the  measured  losses  were 
not  expected  to  be  identical.  !'!.e  same  reasoning  was  applied  to  buoy- 
pairs  15  -  G  and  f  -  P.  Tb.us,  data  from  buoys  A,  !5,  and  C  show  losses 
over  the  0  to  115  mile  range  interval  im  slope  from  the  source,  and  P,  G, 

II  show  down  slope  losses  over  the  0  to  115  mile  interval.  The  data 
gathered  at  buoys  !'  and  K  were  not  used  in  this  report  due  to  lack  of 
computer  time  to  run  ray  traces  and  the  over- lap  with,  data  from  buoys  C 
and  P.  finally,  the  measurement  data  consisted  of  six  independent  sets, 
cadi  set  covering  a  particular  M  mile  range  interval  from  a  particular 
buoy.  There  were  two  sets  of  measurements  for  each  interval,  hut  they 
were  not  combinable. 

The  above  considerations  dictated  what  model  runs  were  to  he  made. 
1‘irst,  of  course,  it  is  not  correct  to  make  one  ray  trace  and  produce  one 
loss  curve  to  represent  the  entire  area.  Rather ,  a  trace  was  made  about 
each  buoy  and  the  appropriate  40  mile  segment  of  the  model  loss  curve  was 
used  Cor  comparison  with  the  measured  results. 

P.  COMPARISON'  MITIIOIXII.OCY 


One  of  the  primary-  objects  of  this  project  is  to  investigate  the 
degree  of  agreement  between  model  predictions  and  observed  propagation 
loss  measurements,  experimental  results  show,  however,  that  measurements 
repeated  under  similar  conditions  vary  significantly  and  do  not  produce 
any  unique  data  set  that  can  he  considered  the  "true"  loss.  Thus,  at 
any  particular  range  several  values  exist  for  measured  loss  and  the  first 
problem  was  deciding  which  the  model  should  agree  with.  Having  decided  what 
the  model  should  agree  with,  it  was  necessary-  to  decide  under  what  conditions 
agreement  did  or  did  not  exist.  Then,  the  final  step  was  to  separate  the 
differences  between  the  model  and  the  observed  data  into  meaningful 
components.  It  is  in  doing  this  that  wc  hope  to  derive  the  most  significant 
insights  into  the  problem. 

At  this  point,  it  will  be  helpful  to  discuss  some  broad  aspects  of 
the  process  of  taking  physical  measurements.  The  .ideas  arc  quite  elementary, 
but  they  have  a  crucial  bearing  on  how  the  comparison  should  be  made  and  on 
what  conclusions  we  may  draw. 

First,  as  a  matter  of  definition,  both  the  model  and  the  measurement 
process  involve  several  "controlled"  and  "uncontrolled"  variables.  In  the 
model  context,  the  controlled  variables  are  those  for  which  specific  values 
are  input  to  the  model.  These  include:  the  source  -  receiver  geometry-; 
the  sound  velocity  profile;  the  bottom  topography;  the  bottom  roughness  and 
reflection  coefficients.  The  uncontrolled  variables  are  those  for  which 
some  average  or  random  value  is  assumed,  or  those  which  arc  disregarded 
entirely.  These  include:  the  phase  relationship  of  multipath,  arrivals; 
scattering  duo  to  small  objects  sue!)  as  fish;  variation  of  the  water  mass 
due  to  currents  and  other  transitory-  effects. 


In  the  experimental  context,  the  controlled  variables  arc  those  which 
are  held  constant  or  permitted  only  limited  variation.  Ideally,  controlled 
variables  arc  constant  and  measurcablc  throughout  an  experiment.  In  this 
experiment  the  source  -  receiver  geometry ,  the  sound  velocity  profile,  and 
the  shape  and  physical  characteristics  of  the  boundaries  are  all  considered 
controlled  variables.  The  uncontrolled  variables  are  similar  to  those 
assumed  for  the  inode! . 

'.‘.hen  measurements  arc  made  under  i'constant  conditions"  this  means 
only  that  the  controlled  variables  should  remain  constant.  The  uncontrolled 
variables  are  permitted  to  vary  as  they  will.  I'.'e  note,  however,  that  during 
any  particular  single  measurement  the  uncontrolled  variables  assume  a  single 
set  of  particular  values,  which  may  or  may  not  represent  their  average  value, 
liuring  the  next  measurement  they  assume  a  new  set.  In  a  well  conducted 
experiment ,  it  is  only  the  variation  of  the  uncontrolled  variables  which 
produces  discrepancies  between  one  measurement  and  the  next,  if  they  arc  made 
under  "constant  conditions". 

With  respect  to  the  model,  "constant  conditions”  means  that  the 
controlled  variables  remain  fixed  and  the  model  will  produce  an  identical 
result  time  after  time  if  average  values  arc  used  for  the  uncontrolled 
variables.  If  randomness  is  introduced  in  the  uncontrolled  variables, 
then  tiie  results  will  vary  from  run  to  run  even  under  "constant  conditions". 

The  PNW'C  model  uses  average  values  for  uncontrolled  variables,  so  for  one 
set  of  conditions  it  will  always  produce  an  identical  prediction. 

Next  we  look  briefly  at  the  notion  of  a  "true  mean  loss’ .  If 
we  visualize  a  lengthy  experiment  which  is  conducted  under  constant  conditions, 
we  expect  the  uncontrolled  variables  to  fluctuate  many  times  throughout  their 
possible  ranges.  If  numerous  measurements  are  made  during  this  time  and  tiie 
results  averaged,  the  average  will  approach,  some  hypothetical  "true  mean 
loss"  for  that  particular  set  of  controlled  conditions.  Accurate  knowledge 
cf  this  quantity  would  he  of  considerable  value.  The  difficulty,  of  course 
is  that  this  process  uses  an  inordinate  amount  of  time  and  creates  great 
difficulty  in  keeping  the  controlled  variables  constant.  So  this  "true  mean 
loss"  is  a  quantity  which  surely  exists,  hut  which  we  do  not  measure.  In 
experiments  such  as  VASSF.I.  XV,  we  compromise  and  take  a  few  measurements 
with  which  we  estimate  what  would  happen  if  we  took  many.  The  crucial  point, 
of  course  is  that  four  measurements  do  not  produce  a  "true  mean"  but  rather 
an  imperfect  estimate  of  .it. 

Returning  to  tiie  problem  of  what  the  model  should  represent,  we  have 
a  clear  solution.  Tiie  model  should  be  a  replica  of  the  "true  mean  loss" 
for  the  particular  set  of  controlled  conditions  involved. 

It  is  important  to  recognize  here  that  even  if  we  have  a  perfect 
model,  in  that  it  does  represent  tiie  "true  mean  loss"  at  every  point, 
we  do  not  expect  the  measured  data  to  agree  with  it  perfectly.  When  we 
take  a  few  measurements,  the  average  of  the  set  is  expected  to  differ  from 
the  true  mean.  W'e  cannot,  therefore,  simply  observe  that  the  model  differs 
from  the  average  of  these  few  measurements  and  thereby  conclude  that  the 
model  is  deficient.  Rather,  it  is  necessary  to  analyze  the  relationship 
of  both  tiie  model  and  tiie  data  to  the  hypothetical  true  mean,  as  well  as 
their  relationship  to  each,  other. 
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he  Kill  use  the  term 'error1 'hereafter  to  refer  to  the  differences  between 
model  or  measured  values  and  the  true  mean.  Use  of  the  word  "error"  does  not 
imply  mistakes  by  the  experimenters  or  model  builders.  'Hie  word  simply  means 
that  a  difference  exists  between  two  quantities.  I  bus,  for  the  difference 
between  the  model  and  the  true  mean  we  use  the  term  "model  error"  and  for  the 
differences  between  measurements  and  the  true  mean  we  use  "experimental  error" 
or  "sampling  error".  The  differences  between  the  model  and  the  measured  data 
are  not  properly  referred  to  as  error  but  as  model-data  discrepancies,  lodcl- 
data  discrepancies  contain  elements  of  both  model  error  and  experimental  error. 

he  now  turn  to  the  method  adopted  to  calculate  the  mean  propagation 
loss  from  a  number  of  measurements.  The  term  "mean  propagation  loss"  expressed 
in  db  does  not,  by  itself,  specify  whether  the  10  log  operation  precedes  or 
follows  the  averaging  operation.  Thus,  it  may  refer  cither  to  10  log  fi  [x.J 
or  I!  [  10  log  x.  ] ,  where  !•  [  ]  represents  the  expectation  of  the  function 

in  brackets,  ancl  x-  is  one  propagation  loss  measurement  expressed  as  an 
intensity  loss  ratio.  A  decision  as  to  which  is  the  appropriate  method  of 
averaging  a  set  of  loss  measurements  depends  partially  upon  the  use  to  which 
the  results  will  be  put;  neither  method  is  always  right  nor  always  wrong. 

The  former  method,  i.e.  taking  the  logarithm  of  the  average  loss,  is  appropriate 
to  specify  the  output  of  a  system  which  responds  linearly  to  energy  input.  The 
latter  method,  i.e.  averaging  the  logarithm  of  the  measurements,  of  db,  is 
appropriate  for  specifying  the  average  output  of  a  system  which  responds 
logaritlimically  to  energy  input.  Two  examples  of  the  latter  would  he  devices 
which  measure  db  and  the  human  ear.  Because  there  are  so  many  more  devices 
which  respond  linearly  than  logarithmically  to  energy  input,  and  because  of 
the  generally  greater  usefulness  of  the  concept  of  average  power  than  the 
average  logarithm  of  power,  the  former  method  is  appropriate  for  the  great 
majority  of  purposes. 

By  the  above  criterion,  tiie  appropriate  method  for  averaging  measured 
losses  in  this  report  would  be  to  average  the  loss  ratios  and  transform  the 
average  loss  to  db.  There  arc,  however,  over-riding  considerations  which  make 
it  desireable  to  adopt  the  other  method,  i.e.  averaging  the  d!>. 

U'e  do  not  contend  that  the  sample  means  obtained  this  way  are  identical 
to  average  intensity  losses,  but  rather  that  they  are  more  useful  for  our 
purposes . 

Much  of  the  work  done  for  this  report  involves  investigation  and  use 
of  the  statistical  distribution  of  propagation  loss  measurements,  and  the 
application  of  certain  statistical  tests.  The  majority  of  these  statistical 
procedures  require  that  one  deals  with  an  approximately  normal  (Gaussian) 
population.  It  was  found  (see  Section  II1-C)  that  the  distribution  of  losses, 
stated  in  db,  is  very  close  to  normal,  and  the  distribution  of  loss  ratios  is 
log-normal.  Since  the  log-normal  distribution  is  very  difficult  to  work  v;ith 
statistically  we  have  adopted  the  procedure  of  averaging  and  analyzing  the 
distribution  of  the  db  measurements  which  are  normal.  A  number  of  other 
factors  justify  using  this  averaging  method. 

1.  The  major  conclusions  of  the  report  will  be  the  same  no  matter 
which  method  is  adopted.  Some  of  the  numerical  results  will  differ,  but 
the  difference  is  analogous  to  reporting  weights  in  grams  rather  than  pounds. 

One  may  convert  back  and  forth. 
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2.  Hie  difference  between  the  "true  mean  losses"  calculated  by 
each  method  is  both  small  and  calcuable.  For  the  data  used  in  this  report 
the  average  difference  can  he  shown  to  be  1.4  db.  Thus,  if  the  model  is 
found  to  be  a  perfect  predictor  of  true  mean  db,  it  will  differ  by  1.4  db 
from  the  true  mean  intensity  loss,  on  the  average. 

3.  A  description  of  the  distribution  of  db  is  just  as  useful  as 
a  description  of  the  distribution  of  intensity  ratios.  Given  cither  one 
we  may  calculate  the  other,  as  well  as  related  quantities. 

G.  DCFINTTION'S 


Several  tenns  are  used  in  the  remainder  of  the  report  which  have 
commonly  known  meanings,  but  which  arc  used  very  specifically  here.  It  is 
important  to  understand  the  restrictive  meaning  given  them  here. 

1.  "Measurement1'.  This  term  is  used  to  denote  the  smallest 
discrete  amount  of  data  used.  As  the  projector  is  towed  toward  or  away 
from  a  buoy,  a  continuous  range- loss  curve  is  generated.  This  curve  is  then 
broken  into  one  mile  segments  and  the  average  loss  in  each  segment  is  termed 
a  "measurement".  Towing  the  projector  for  40  miles  thus  produces  40 
"measurements"  at  each  buoy.  Since  six  buoys  were  used  and  there  were 

four  projector  rims,  we  have  40  x  6  x  4  =  060  possible  measurements.  Due 
to  some  missing  data  only  674  of  these  were  actually  obtained. 

2.  "Sample".  A  sample  is  generally  made  by  grouping  measurements 
into  sets  of  four.  Each  sample  thus  contains  four  (or  less)  repeated 
measurements  made  under  the  same  conditions.  The  four  measurements  made 
while  the  projector  was  25  miles  from  buoy  "C"  arc  one  "sample".  Some 
samples  contain  less  them  four  measurements  due  to  missing  data. 

3.  "Sample  'lean".  If  the  measurements  in  one  sample  are  averaged 
the  result  is  the  "sample  mean".  It  is  the  average  loss,  in  db,  for  that 
sample. 

4.  "Sample  variance"  is  the  variance  of  measurements  in  a  sample. 

5.  "Pooled  variance"  is  a  weighted  average  variance  for  several, 
or  all,  samples  combined.  The  weighting  takes  into  account  the  varying 
nunber  of  measurements  in  each  sample. 
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III. 


RFSl'LTS  .‘\NP  DISCUSSION' 


A.  GENERAL.  The  General ,  overall  results  of  the  VASSF.L  XV  measure¬ 
ments  arc  depicted  in  figures  3  and  4.  Up  slope  and  down  slope  measurements 
are  separated  for  reasons  discussed  ir.  Section  II.  The  figure  shows  one  loss 
trace  for  each,  projector  run,  one  trace  which  is  the  average  of  losses  from 
the  individual  runs  and  one  trace  which  shows  the  loss  predicted  by  the  model. 
Tliis  figure  contains  several  important  features  which  are  analyzed  in  detail 
in  subsequent  sections. 

1.  At  any  particular  range,  considerable  variation  exists  in 

the  measurements  from  one  run  to  another.  Tims,  repeated  measurements  made 
between  the  same  points  and  under  similar  conditions  do  not  yield  consistent 
results.  Frequently  differences  of  over  10  db  can  he  found  in  repeated 
measurements . 

2.  Tiie  trace  for  each,  individual  pass  represents  the  value  that 
would  be  found  in  a  five  minute,  moving  window,  averaging  device.  This  has 
a  very  definite  smoothing  effect  on  the  data,  but  short  term  oscillations 

of  over  10  db  in  a  small  number  of  miles  are  nevertheless  quite  common.  The 
individual  measurements  generally  oscillate  more  widely  than  the  average. 

3.  The  model  generally  predicts  less  loss  than  the  measurements 
indicate.  Measurements  and  predictions  agree  better  at  short  range,  perhaps 
to  30  or  40  miles,  than  at  long  range  where  the  model  consistently  predicts 
too  little  loss  by  several  db. 

4.  In  regions  where  the  measurements  show  a  definite  repeatable 
"fine  structure",  i.e.  oscillation  patterns  which  are  consistent  from  run 

to  run,  the  model  seldom  follows  the  pattern.  In  general,  the  model  is  much 
smoother  than  either  the  individual  runs  or  the  four-run  average  particularly 
at  longer  ranges,  where  the  model  often  remains  in  a  1  or  2  d'  interval  for 
many  miles. 

5.  bach  individual  rim  displays  oscillations  which  do  not  appear 
to  vary  conspicuously  with  range;  that  is,  the  oscillations  observed  in 
the  data  at  ranges  from  100  to  US  miles  are  not  significantly  different 
than  those  in  the  30  to  50  mile  interval.  Also,  the  oscillations  are 
apparently  randan  in  the  sense  that  they  are  not  consistently  repeatable  from 
run  to  rim.  Kith  few  exceptions,  the  patterns  observed  in  one  run  are 
reminiscent  of  those  seen  in  other  runs  but  cannot  be  superimposed  to 
produce  a  consistent  pattern. 

/ 

6.  There  is  further  evidence  of  randomness  in  the  individual  runs, 
in  that  they  do  not  follow  simple  patterns  expected  of  interference  between 
plane  waves.  The  loss  curves  do  not  have  consistent  oscillatory  periods 
nor  amplitudes  and  do  not  display  the  arch- like  patterns  characteristic  of 
interference  of  simple  multipath  propagation  modes. 

B.  *■  10DF.L- DATA  PI SCREPAXC I FS .  The  previous  section  presented  a  general 
graphical  picture  of  how  the  model  predictions  and  the  measurements  agreed. 

In  this  section  a  quantization  of  the  model-data  differences  is  presented 
which  is  intended  primarily  to  be  useful  to  potential  users  of  the  model.  We 
do  not  yet  address  the  probabilistic  problems  involved  in  comparing  the  model 
to  a  hypothetical  "true  mean  loss".  Rather,  we  use  the  directly  observable 
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model-data  discrepancies  to  indicate  to  potential  model  users  what  agreement 
might  he  expected  between  the  model  and  losses  winch  are  measured  or 
experienced.  liven  the  user  who  makes  no  measurements  as  such,  hut  only 
listens  to  a  sonobuov#is  interested  in  this  relationship,  for  he  is  really 
experiencing  one  unique  loss  value  which  is  different  than  the  true  mean. 

The  data  is  organized  into  samples  which  contain  several  measure¬ 
ments  and- one  model  prediction.  The  differences  between  each  measurement 
and  the  corresponding  prediction  are  plotted  in  Figure  5.  The  differences 
arc  plotted  separately  for  cadi  buoy,  he  sec  here,  for  example,  that  eight 
of  the  measurements  obtained  at  buoy  C  exhibit  between  7  and  S  db  less  loss 
than  the  model  predicted.  Also  shown  on  each  plot  is  the  mean  or  average 
difference  between  all  the  measurements  made  at  a  buoy  and  the  model 
prediction.  For  example,  the  measurements  made  at  buoy  I?  averaged  about 

2.5  tlb  more  loss  than  the  model  predicted.  Sane  pertinent  features  shown 
here  again: 

•  Agreement  between  the  model  and  the  data  is  better  at  close 
range  than  at  long  range. 

•  The  measurements  arc  quite  widely  scattered  about  the  model. 
Generally  about  20  db  separates  the  deviation  limits  at  each  buoy. 

Rather  than  providing  a  basis  for  evaluating  the  model ,  the 
information  contained  in  the  figure  indicates  to  a  potential  user  of  the 
model  what  he  might  expect  ir.  the  way  of  accuracy.  The  figure  says  that 
the  model -docs  agree  fairly  well  on  the  average  at  close  range,  but  that 
any  individual  measurement  is  likely  to  deviate  from  the  model  by  several 
db.  At  longer  ranges,  the  model  predicts  consistently  too  little  loss 
for  the  particular  area  where  those  measurements  were  made.  To  see  how 
the  model  agreed  over  all  —  for  all  ranges  —  the  data  in  Figure  5  is 
summed  into  one  plot  in  Figure  6.  This  figure  shows  the  relation  of  all 
measurements  to  the  model.  The  average  deviation  is  about  +  4.5  db.  This 
docs  not  mean  the  average  model  error  is  4.5  d!  ,  but  only  that  on  the 
average  the  measured  losses  were  4.5  db  more  than  the  model  predicted. 

Figure  7  presents  the  cumulative  distribution  of  tiic  data  in 
Figure  fi.  It  shows  what  fraction  of  all  the  measurements  are  within  so 
many  db  of  the  model.  For  example,  505  of  the  measurements  are  within 

5.5  db  of  the  model,  SO 5  arc  within  9.0  db  and  955  arc  within  13  db. 

C.  BCPHRIMiyrAL  FUROR  ANALYSIS. 

1.  General .  As  noted  earlier,  the  measurements  show  considerable 

variability  within  each  sample.  In  other  words.,  repeated  measurements  made 
between  the  same  two  pointy  under  nominally  identical  controlled  conditions, 
differ  significantly  from  one  to  another.  These  differences  are  "experi¬ 
mental  error".  It  is  important  to  examine  the  experimental  error,  for  it 
bears  heavily  on  what  sort  of  conclusions  may  be  drawn  from  the  data  and 
it  has  strong  implications  concerning  future  propagation  loss  measurement 
experiments.  Some  of  the  factors  involved  arc: 
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•  Generally,  as  the  experimental  error  in  a  set  of  measurements 
increases,  so  also  docs  the  number  of  measurements  required  to  obtain  an 
acceptable  estimate  of  the  true  mean.  Conversely,  the  confidence  that  any 
single  measurement  is  close  to  the  mean  decreases. 

•  If  a  set  of  measurements  has  a  large  experimental  error,  we 
can  expect  the  means  of  samples  to  differ  considerably  from  the  true  mean. 

If  kc  try  to  make  comparisons  between  a  theoretical  model  and  some  measure¬ 
ment  data,  we  arc  less  certain  whether  the  observed  differences  arc  due  to 
model  error  or  experimental  error. 

•  The  value  of  a  propagation  loss  model  is  not  determined 
solely  by  how  well  it  predicts  the  mean  propagation  loss  between  two  points. 

A  given  model  could  be  an  acceptable,  even  perfect,  predictor  of  true  mean 
loss,  but  fail  to  be  useful  because  actual  loss  values  are  widely  distributed 
about  the  troc  mean.  In  other  words,  a  precise  prediction  of  a  true  mean 
may  not  tell  much  about  what  will  result  from  a  single  measurement  if  the 
experimental  error  is  significant. 

•  If  data  variance,  or  experimental  error,  for  a  particular 
set  of  controlled  conditions  arc  found  to  be  too  high,  it  can  be  reduced 
only  by  "controlling"  one  or  more  of  the  now  uncontrolled  variables,  in 
the  model  context,  this  means  using  specific  rather  than  average  or  random 
values  for  a  now  uncontrolled  variable.  Investigation  of  the  data  variance 
may  thus  encourage  or  discourage  further  model  development. 

•  Referring  to  plots  of  mean  propagation  loss  vs  range  and 
model  loss  versus  range,  in  Figures  3  and  4  we  sec  that  the  loss  measure¬ 
ments  arc  much  more  oscillatory  with  range  than  the  model  predicts.  A 
serious  question  arises  as  to  whether  the  data  oscillation  is  due  primarily 
to  changes  in  range  and  the  associated  controlled  variables  or  due  to 
random  fluctuation  of  the  uncontrolled  variables.  If  the  latter  is  the 
primary  cause,  the  true  mean  loss  might  lie  a  fairly  smooth  curve,  much  like 
the  model.  This  does  not  suggest  that  oscillations  do  not  really  occur  in 
individual  measurements  —  they  do.  Rather,  the  question  addressed  is  the 
character  of  the  oscillations.  Investigation  of  the  experimental  error 
can  produce  some  insight  into  this  question. 

2.  Sample  Variance.  The  basic  measure  of  experimental  error  is 
given  by  the  "sample  variance"  which  is  defined  by  the  relation: 


where  St  =  variance  of  the  i—  sample 


=■  mean  of  the  propagation  less  measurements,  in  dh,  in  sample  i 
X.j  =  the  j—  measurement  of  propagation  loss  in  the  i— sample 
=  number  of  measurements  included  in  sample  i 


?0 


It  is  appropriate,  also,  to  introduce  the  notion  of  a  "sample  space".,  This 
term  simply  refers  to  the  set  of  conditions  that  prevailed  for  the  i—  sample. 
Or,  it  is  the  particular  state  of  the  controlled  variables  which  prevailed 
for  the  i—  sample.  Our  sample  spaces  arc  defined  by  a  one  mile  range 
increment  referenced  to  a  particular  buoy,  a  particular  velocity  profile,  a 
particular  bottom  contour  and  so  on. 

The  sample  variance  was  calculated  for  each  of  the  71  samples  which 
contained  4  measurements  and  the  89  samples  which  contained  3  measurements. 

A  tabulation  of  the  variances,  along  with  other  data  arranged  by  sample  is 
shown  in  Appendix  A.  In  order  to  progress  toward  a  general  description  of 
experimental  error,  we  form  the  distribution  of  sample  variance  as  shown 
in  figure  8.  This  figure  shows 0 for  example  that  four  samples  had  a 
variance  of  between  22  and  24  db“,  and  24  sajnnlcs  had  a  variance  between 
4  and  6  db”.  It  should  be  recalled  that  these  arc  values  for  the  variance, 
not  the  standard  deviation  or  familiar  "one  sigma".  The  "sigma"  is  the 
square  root  of  these  variance  figures. 

3.  Population  Variance,  figure  8  shows  that  sample  variance  ranges 
from  less  than  2  db  for  27  samples  to  over  90  dn  for  one  dispersed  sample. 
Ibis  disparity  of  variance  is  addressed  below. 

If,  as  in  developing  the  idea  of  a  "true  mean",  we  regard  the 
piopagation  loss -at  a  single  sample  space  as  a  random  variable,  it  will 
have  some  "true  variance"  as  well  as  a  "true  mean".  Again,  it  could  be 
measured  only  over  a  time  period  long  enough  to  include  a  number  of 
oscillations  of  the  uncontrolled  variables.  Ibis  hypothetical  true  variance 
is  called  '"population  variance". 

The  observed  sample  variances  are  subject  to  the  same  vagaries 
of  the  sampling  process  as  are  the  sample  means.  Thus,  individually  they 
arc  imperfect  estimates  of  the  population  variance. 

A  description  of  the  population  variance  involves  determining  how 
variance  changes  from  one  sample  space  to  another.  So  before  attemotine  this, 
we  test  to  see  if  it  can  be  shown  that  population  variance  changes  at  all. 

If  we  cannot  show  that  it  does,  in  fact,  change, obviously  we  cannot  describe 
how  it  changes.  The  best  description  of  the  population  variance  in  that 
event  is  that  it  is  constant  and  is  equal  to  the  pooled  variance  of  all 
samples. 


The  method  used  to  do  this  is  statistical  hypothesis  testing. 
So  we  advance  the  hypothesis  the  population  variance  is  constant  in  all 
sample  spaces  and  is  equal  to  the  pooled  variance  of  all  samples .  In 
terms  of  the  experiment,  we  test  the  hypothesis  that  the  true  variance  of 
possible  measurements  is  the  same  at  one  point  as  at  any  other  in  the 
experiment  area  and  does  not  change  significantly  with  range  from  a  buoy. 
The  observed  differences  in  sample  variance  arc  attributable  to  the 
sampling  process,  if  the  hypothesis  is  accepted. 
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SAMPLE  VARIANCE  (dB  SQUARED) 


The 'pooled  variance"  is  a  combination  of  all  the  sample  variances 
with  weighting  hy  sample  size.  It  is  calculated  from  the  relation: 


c.-2  = 

‘V 

where :  n -  = 

1 

9 

sr  = 

i 

K 

For  the  160  samples 
variance  was: 


E  <V  '[i 

i  (tij)  •  h 

number  of  measurements  in  the  i—  sample 
sample  variance  of  the  i—  sain))le 
number  of  samples  used 

which  contained  either  3  or  4  measurements,  the  pooled 


So2  =  12.1  d’-.2 

And  the  pooled  standard  deviation  was: 


Sp  =  3.48  db 

To  test  the  hypothesis  we  first  construct  the  theoretical  distribution  of 
sample  variances  to  be  expected  if  the  true  variance  is  indeed  constant 
over  all  sample  spaces.  The  next  step  is  to  compare  the  observed  distribution 
of  sample  variance  with  the  theoretical  distribution.  If  substantial  agreement 
exists,  we  conclude  that  the  variance  cannot  be  shown  to  vary  from  sample  to 
sample. 


The  appropriate  statistic  to  calculate  the  theoretical  variance 
distribution  is  the  "G'.i  square  over  df"  (X“/df)  distribution.  It  is  used 
to  calculate  the  expected  distributions  of  sample  variance  in  89  samples  of 
size  3  and  71  samples  of  size  4.  The  two  distributions  are  then  summed. 
Results  appear  in  Figure  9  where  we  sec,  for  example,  t;hat  12  samples  would 
be  expected  to  have  variances  between  12.1  and  14.5  db".  For  convenient  use 
of  the  X"/df  tables,  the  horizontal  scale  qf  the  figure  is  broken  into  even 
fractions  of  Sp  rather  than  into  whole  db".  he  next  determine  the  number 
of  samples  which  actually  do  have  variances  in  these  intervals.  The  result 
is  similar  to  Figure  8  except  that  the  variance  intervals  (horizontal  scale) 
have  been  changed  to  coincide  with  Figure  9.  The  observed  distribution 
appears  in  Figure  10  along  with  the  theoretical  distribution  superimposed. 
Figure  10  shows  that  the  curves  are  roughly  similar.  To  test  for  similarity, 
we  use  the  chi  -  square  one  sample  test  which  shows  that  the  two  distributions 
are  not  significantly  different  at  the  .2  level  of  significance.  In  summary, 
then,  we  accept  the  hypothesis  that:  The  population  variance  is  constant 
over  the  experiment  area,  and  is  equal  to  12.1  do  . 
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EXPECTED  NUMBER  OF  SAMPLES 


FIGURE  9 


NUMBER  OF  SAMPLES 


SAMPLE  VARIANCE  (FRACTIONS  OF  6Z  ) - » 

FIGURE  10 
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4.  Distribution  of  Experimental  Hrror.  Since  all  of  the  statistical 
tests  used  in  this  report  contain  the  implicit  assumption  that  the  population 
of  measurements  in  each  sample  space  is  normally  distributed,  it  is  important 
to  determine  if  this  assumption  is  valid.  The  basic  method  of  checking  the 
data  for  normalcy  of  distribution  is  to  calculate  the  theoretical  distribution 
of  single  measurement  deviations  from  the  sample  means  which  would  he  expected 
if  the  populations  arc  indeed  normal,  and  to  compare  this  with,  the  observed 
distribution  of  deviations  from  the  sample  means,  for  all  samples. 


To  construct  the  theoretical  distribution,  we  use  the  fact  that 
fer  samples  of  size  from  a  normal  population,  the  distribution  of  measure¬ 
ment  deviations  from  the  sample  means  (got  the  true  spans)  is  normal  with  a 
mean  of  zero  and  a  variance  of  ( K'-l\  S:  “  (where  Spz  is  the  population 
variance).  \  N  / 

Thus,  for  a  population  variance  (S  p")  of  12.1  .lb  we  obtain  the 
following  expected  variances  for  samples  of  size  X. 


SA'TU:  SIZE  s2 


N  =  1 

0 

O'! 

II 

X. 

6.05  db2 

N  =  3 

8.07  A  2 

N  =  4 

9.08  d:-2 

0 


2.46  c»' 
2.84  do 
3.01  dh 


Here,  s“  is  the  variance  of  the  distribution  of  measurements  about  the 
sample  means.  And  we  have  the  following  samples: 


SAMPLE  SIZE 
N  =  1 
N  =  2 


MO.  OF  SAMPLES 
(10) 

(52) 

(89) 

(71) 


TOTAL  MEASUREMENTS 
19 
104 
267 
284 


674 


Tlie  number  of  deviations  which  would  be  expected  to  fall  into  1  db  intervals 
is  calculated  for  all  samples,  and  the  results  are  summed  in  figure  11.  for 
example,  in  a  normal  population  we  expect  99.7  deviations  from  sample  means 
of  between  0  and  +  1  db  and  26.2  deviations  of  +  4  to  +  5  db. 

Observed  deviations  arc  then  also  plotted  in  figure  11  super¬ 
imposed  on  the  theoretical  distribution.  The  figure  reveals  only  minor 
differences.  An  appropriate  test  for  equality  of  the  two  distributions  is 
the  Kolmogrov- Smirnov  one  sample  test.  To  apply  it  we  form  the  cumulative 
of  each  distribution  and  observe  that  the  largest  percentage  discrepancy 
between  the  theoretical  and  observed  cumulative  distribution  is  2.05%.  For 
a  sample  size  of  674,  wc  accept  the  hypothesis  of  equality  of  distribution 
at  the  e<  =  20%  level.  The  significance  of  this  finding  can  be  stated: 


SUPERPOSED  DISTRIBUTION  OF 
DEVIATIONS  FROM  SAMPLE  MEANS 


FIGURE  II 
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The  ocasurcncnt:.  oMainai  in  this  experiment  do  not  demonstrate 
n  departure  fron  nenial  distribution.  '  c  have  not  "proved”  that  the  data 
are  normally  distril  uted,  only  shown  that  thev  do  not  contradict  the  assumption. 


!n  sjnsaiy  t^en,  •~e  accept  the  hypothesis  that  the  experimental 
error  is  a  torn!!”  distributed  random  variable  with  a  constant  standard 
deviation  of  5.-5.  :  . 


!».  K  i.U.  li-y.y  .v;\ly.sis. 

1.  ilcnernl. 


i’r  first  considering  the  experiment  results  and  the  model  pre¬ 
dictions  is*  Section  I1I-A  we  observed  that  the  node!  appeared  to  predict  too 
little  loss  cxnccially  at  lonr.cr  ranges.  \lso,  t!>c  sai^jlc  means  were  scattered 
about  the  model  to  sene  extent. 

At  this  point,  after  analyzing  experimental  errors  and  model-data 
discrepancies,  there  remains  considerable  uncertainty  concerning  the  model 
itself. 


a.  V-l’.en  differences  occur  between  the  model  and  the  data,  can  the 
difference  *'c  attributed  solely  to  sampling  error  in  the  data  or  is  there  evidence 
of  significant  model  error? 

’•>.  Hos:  large  a  difference  must  occur  before  v;c  can  assert  with 
some  ccrtaintv  t!:at  node!  error  exists? 

c.  hh.cn  there  is  a  substantial  bias  difference  between  the  model 
and  the  data,  but  the  model  seems  to  resemble  the  shape  of  the  data  curve  (such 
as  tiic  buoy  A  results),  can  we  measure  the  degree  of  correspondence  in  the 
shape  of  tiic  two  curves. 

d.  Where  tise  model  runs  generally  through  the  data,  as  in  the 
case  of  buoys  C  and  !:,  is  the  model  an  acceptable  representation  of  the  data? 

Having  investigated  the  experimental  error  of  the  measurements,  we 
arc  noii  in  a  position  to  answer  these  questions  and  to  investigate  the  model 
error. 


2.  Test  for  Presence  of  Model  Hrror. 

The  basic  method  for  determining  if  model  error  is  present  will  he 
statistical  hypothesis  testing.  In  each  sample  space  we  have  a  nirnbcr  of 
measurements,  the  sample  mean,  a  knowledge  of  sample  variance,  and  a  model 
prediction.  Kc  will  formulate  hypotheses  concerning  the  model  and  the  data, 
and  through  appropriate  tests  cither  accept  or  reject  the  hypotheses  for  each 
sample  space.  Kc  then  have,  for  cadi  sample  space,  a  decision  as  to  whether 
or  not  the  model  contains  significant  error  in  that  interval.  A  judgment 
that  the  model,  as  a  whole,  contains  significant  error  is  based  on  the  relative 
nunber  of  samples  which  do  and  do  not  show  model  error.  The  first  step  is  to 
test  for  agreement  between  tiic  model  and  the  hypothetical  "true  mean".  To 
do  tiiis  we  form  the  hypothesis  that:  In  each  sample  space  the  model  value 
is  equal  to  the  true  mean  loss  for  that- sample  space.  This  does  not  mean,  of 


course,  that  the  nodcl  value  and  the  sample  means  mast  ho  identical.  Rather 
uc  assume  that,  while  uc  do  not  know  what  tlic  true  sample  means  arc,  we  do 
know  now  taie  (.casurcmonts  ait;  distributed  about  the  true  mean.  bo  ’•« 

hypothesise  that  the  model  value  is  the  true  mean  in  each  sample  space.  If 
the  distribution  of  measurements  in  a  sample  is  far  from  the  model,  v;c  will 
conclude  that  the  model  value  is  not  the  true  mean  in  that  smaple  space,  and 
reject  tlic  hypothesis  that  it  is.  This  test  is  repeated  in  cadi  sample  space. 

Hie  appropriate  test  is  the  t  -  test  for  equality  between  a 
sample  mean  and  a  hypothetical  mean. 

The  test  will  he  applied  twice  to  each  sample,  once  with  a  level 
of  significance  {J*  )  equal  to  10°  and  once  v:ith<X  =  1”.  The  acceptance 
limits  for  tlic  difference  hetecn  model  and  samnlc  mean  from  tlic  ”’t"  distri¬ 
bution  arc  shown  in  Table  2.  If  model  and  sample  means  differ  lv  more  t!ian 
t’ncse  amounts,  the  model  is  rejected  as  being  the  true  mean  in  that  sample 
space. 


SA,:P!.l"  SI  Zb 

n 

r? 

=  v. 

::  =  l 

5.73  d1' 

8.90  dl 

•1.07  dr 

6 . 3°  i! 

=  3 

3.31  d’; 

8.1  !  di. 

'•  =  -i 

2.88  dh 

4.48  dh 

ACCmAXCIi  LIMITS  FOR  Mi-AlS  TI.ST 


tabu:  2 

Hie  results  of  each  test  are  sliown  in  Appendix  A,  arranged  by  sample;  a 
tabulation  of  the  results  by  huov  is  shown  here  in  Table  3. 


<A  =  m 

= 

n 

«JPV 

RANCH 

INTF.RVAL 

SAMPLES 

ACCP.PT 

pjuiicr 

ACCI-PT 

iuji:cr 

C 

0-40  mi 

39 

16 

23 

28 

11 

F 

0-40  mi 

36 

18 

18 

24 

12 

15 

35-75  mi 

40 

22 

18 

33 

7 

G 

35-75  mi 

38 

6 

32 

13 

25 

A 

75-115  mi 

38 

3 

35 

15 

23 

li 

75-115  ni 

40 

38 

6 

34 

TOTAL 

231 

67 

164 

119 

112 

TABliLAinii  RiiSi’LTS  Oh  Ml’AWS  TLSl'S 
TAliLF.  3 
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These  results,  of  course,  nrc  not  intended  solely  to  indicate  acceptance  or 
rejection  of  the  model  in  its  entirety,  but  also  to  indicate  areas  of  agree¬ 
ment  and  disagreement,  lac  significant  results  of  tbc  tests  appear  in  the 
columns  ’’ended  "1T.IIXT",  which  indicates  the  number  of  sample  snaecs  in 
which  the  model  was  rejected  as  the  true  mean.  ror  example,  we  sec  that  of 
the  3.8  samples  taken  at  >’uoy  \,  35  resulted  in  rejection  of  the  model  at 
the  10 ?  level. 

It  is  important  that  the  rejections  be  properly  interi>rctcd. 

\  rejection  at  the  10?.  level  means  that,  in  that  sample  space,  the  model 
was  sufficiently  different  from  the  sample  mean  that  the  difference  could 
not  he  attributed  solely  to  sampling  error.  The  10?  significance  level 
means  only  that  the  rejection  has  a  10?  or  less  chance  of  being  wrong,  and 
tiic  model  actually  being  equal  to  the  true  mean.  P.cicctior.  of  the  model 
at  the  1?  level  is  consequently  a  much  more  certain  rejection,  admitting 
only  a  1?  chance  of  being  wrong. 

As  to  the  overall  correspondence  of  the  model  and  the  data,  there 
are  numerous  samples  where  model  error  is  shown  to  exist  with  a  high  degree 
of  certainty.  The  model  was  rejected  in  over  7C?  of  the  sample  spaces  at 
the  10?  level  and  in  over  48?  at  the  1?  level. 

It  must  lie  emphasized  stronglv,  however,  that  these  results 
reflect  primarily  on  the  certainty  with  which  the  rejections  are  made  and  give 
little  information  on  the” size  or  distribution  of  differences  between  the 
model  and  the  true  means. 

Another  factor  requires  consideration  in  interpreting  Table  3. 

As  it  happens ,  the  model  is  rejected  so  frequently  that  there  is  little 
question  of  certainty.  But  had  the  results  been  less  overwhelming  we  would 
have  to  consider  how  many  rejections  should  occur  if  the  model  were  indeed 
perfect.  Mien  we  make  a  number  of  tests  at  the  10?  level,  we  accept  tbc 
fact  that  we  will  he  wrong  about  10?  of  the  time.  Consequently,  if  we  make 
231  tests  as  we  did  here,  we  expect  to  get  about  23  rejections' if  the 
model  is  perfect.  If  our  total  number  of  rejections  had  been  much  closer 
to  23  instead  of  164  we  would  have  to  consider  the  possibility  of  erroneously 
rejecting  a  "good"  model . 

Another  perspective  of  these  results  is  presented  in  Figures  12 
through  17.  Each  contains  a  loss  versus  range  plot  for  results  obtained  at 
one  buoy.  Sample  means  and  the  model  are  plotted  on  each.  About  40  sample 
spaces  are  represented  on  cac!.  curve.  There  arc  a  number  of  interesting 
though  qualitative  features  in  these  figures. 

I'UOY  C:  The  model  here  is  not  badly  biased  and  appears  to  run 
thru  the  data  fairly  well.  The  "t"  tests,  however,  show  only  moderate 
regions  of  statistically  acceptable  agreement,  for  the  data  excursions  arc 
sufficient  tc  indicate  significant  model  error. 

BI'OY  F:  Agreement  is  fair.  The  model  did  not  reflect  the 
regions  of  high  loss  between  15  and  20  miles  and  between  27  and  40  miles. 

BUOY  B:  Model-data  agreement  was  closest  in  results  from  this 
buoy.  A  remarkable  shape  correspondence  exists  between  57  and  70  miles. 
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PROPAGATION  LOSSES  AT  BUOY 


FIGURE  14 


RANGE  FROM  SOURCE  (N.MI.) 


RAN6E  FROM  SOURCE  (N.MI.) 


FIGURE  17 


BUOY  C.:  'Hie  model  consistently  showed  al>out  5  db  too  little 
loss.  Both  curves  are  relatively  flat  with  fair  shape  correspondence. 

BUOYS  A,  I!:  The  model  was  consistently  off  8  to  10  dh  here  at 
long  range.  There  is  some  shane  correlation  at  buoy  A,  hut  little  at  buoy 
I!.  Both  buoys  were  the  same  distance  from  the  target  (75-115  mi)  but  the 
model  predicts  somewhat  different  results  for  losses  up  slope  to  buoy  A  and 
down  slope  to  buoy  II. 

5.  Components  of  Model  b.rror . 

The  previous  sections  have  established  the  satistical  certainty 
that  model  error  exists  and  have  investigated  the  character  of  the  experi¬ 
mental  error.  But  we  have  not  yet  tried  to  describe  the  model  error  or 
that  error  between  the  model  and  the  true  means. 

Since,  in  any  particular  sample  space,  the  true  mean  loss  is 
unknown,  we  will  not  lie  able  to  determine  the  model  error  present  in  any 
single  sample  space.  But  it.  is  possible  to  determine  some  characteristics 
of  the  model  error  by  considering  error  distributions. 

Before  proceeding,  it  will  be  helpful  to  look  more  closely  at 
how  "model  error"  may  he  described.  ’ leasurements  reveal  that  the  model 
persistently  predicted  too  little  loss  over  considerable  range  intervals. 

This  leads  to  describing  the  model  error  in  two  components :  The  "bias 
error"  and  what  will  be  called  "tracking  error".  These  two  components 
arc  not  associated  with  different  physical  processes;  the  separation  is 
only  for  mathematical  convenience.  The  components  will  have  separate 
significance  to  model  designers  only  if  they  can  be  associated  with  distinct 
parts  of  the  propagation  loss  model.  The  separation  is  made  for  convenience 
of  description  and  may  be  interpreted  variously  by  various  parties. 

The  "bias  error"  is  defined  as  the  mean  model  error  over  a  number 
of  sample  spaces.  It  only  describes  model  error  over  some  interval  of  sample 
spaces,  and  its  numerical  value  will  depend  on  the  interval  over  which  we 
calculate  it.  he  have  chosen,  rather  arbitrarily,  to  calculate  the  mean  bias 
over  sets  of  sample  spaces  associated  with  each.  buoy.  Model  bias  in  the 
interval  0  to  40  miles  is  given  by  bias  in  the  buoy  C  and  buoy  F  samples;  model 
bias  from  55  to  75  miles  is  indicated  by  buoy  B  and  G  samples;  model  bias  from 
75  to  115  miles  is  indicated  by  buoy  A  and  I!  samples. 

’Hie  "tracking  error"  represents  a  fluctuating  error  superimposed 
on  the  bias.  Combined,  the  two  produce  model  error. 

The  relation  is  represented  graphically  in  Figure  18  which  shows 
hypothetical  model  and  loss  curves.  In  interval  A  there  is  about  10  db  bias 
error  between  the  model  and  the  actual  loss  curve.  But  tracking  error  is  very 
small  for  when  the  bias  is  removed  the  two  curves  match  well. 

In  interval  B  there  is  about  4  db  bias  and  also  significant  tracking 
error.  When  the  bias  is  removed  the  curves  differ  significantly. 

In  interval  C  there  is  little  or  no  bias  but  significant  tracking 

error. 
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In  summary,  "trac1  ir.4  errci"  yrcvi  ir*  soac  scasure  of  h«*r  wel  I  t1* 
sliapc  of  the  rxxlel  loss  curve  agree*.  »!t:>  the  siapc  of  the  true  loss  curve  and 
"bias  error'"  indicates  hcK  tasch  the  two  curves  are  separated  in  an  interval. 

He  now  want  to  estimate  the  values  of  the  two  con5w1r.cr.ts.  Sins 
lias  already  i-ecii  dctcrairjcd  ir  -Section  III -!•  >i:t  t lore  it  was  calculated  as 
the  neon  deviation  of  t"'e  rs?JeI  fine  t5.e  sample  ncanf,r.ct  'he  true  zeans  as 
we  require.  If  we  assire,  ncuever,  that  the  sample  -sens  are  unbiased 
estimates  of  the  true  rears,  the  Has  fi  bres  Tarmac"  the  same  value.  The 
assumption  of  unbiased  samples  reai.s  w  assint  the  ncssurir;  and  processing 
equipment  introduced  only  random  errers  *.  iti  zero  mean  and  did  not  consistently 
raise  or  loiter  measurements  and  that  the  sazr.lrs  obtained  ’.cere  randomly  selected 
from  all  measurements  which  night  lave  l  eer,  made  moments  earlier  or  later.  In 
the  absence  of  contraiy  evidence,  v.e  ado.-t  these  assumptions.  Titus,  the  bias 
indicated  in  sarnies  at  cadi  buoy  is: 
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BbPY  ii: 

-  s.2  »r 

-  9.5  di 

75  to  115  ci’es 

Kc  new  i.ant  to  estimate  the  model  tracl  ini;  error.  To  begin  with, 
we  have  the  distribution  of  measurement  deviations  from  the  code!  in  Figure  19 
which  shows  ho.:  many  neasurements  differed  from  t!:e  maiel  by  a  given  amount. 

Ihicli  of  the  deviations  is  a  random  combination  of  experimental  and  model  errors. 
One  of  the  10  db  deviations,  for  example,  might  have  occurred  because  a  measure¬ 
ment  was  95  <!b,  the  tns  mean  90  «T  ,  and  the  model  35  •!<’.  Tltc  M  .?•  combined 
deviation  is  made  iq>  of  5  d'»  sar*>Iin.-  01.  'r  and  5  dh  model  error. 


Hie  first  step  in  separating  the  combined  errors  is  to  remove  tne 
model  bias  error,  Graphically,  this  involves  repositioning  tiie  model  trace 
on  the  loss  curve  so  that  the  model  runs  generally  through  the  data,  ."a thematically, 
we  de-bias  the  model  by  anplving  tltc  appropriate  bias  factor  to  tile  model  value  in 
cadi  sample  space.  The  effect  is  to  remove  the  bins  error  and  produce  Figure  20 
which  shows  the  deviation  of  measurements  about  the  Je-hiascd  model.  In  this 
figure,  cadi  of  the  deviations  is  comnosed  only  of  sampling  error  and  tracking 
error.  And  if  we  can'tcnovc"  the  sampling  error  from  this  distribution,  the  tracking 
error  alone  will  remain. 


Tiie  sampling  error  was  found,  in  Section  III -C,  to  be  a  normally 
distributed  random  variable  with  zero  mean  and  a  standard  deviation  of  3.48  db 
Tiie  theoretical  distribution  of  sampling  errors  in  674  measurements  may  be 
constructed  as  in  Figure  21  which  shows  the  expected  distribution  of  sampling 
errors.  Tiiere  is,  of  course,  no  way  of  determining  the  exact  sampling  errors 
encountered  in  the  experiment.  For  purposes  of  estimating  the  tracking  error, 
we  will  assume  that  the  theoretical  distribution  of  sampling  error  is  an 
adequate  representation  of  actual  sampling  errors. 

To  obtain  an  estimate  of  the  tracking  error,  wc  reason  as  follows: 
Figure  20  is  the  distribution  of  sampling  error  plus  tracking  error  and  Figure  21 
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DEVIATIONS  OF  MEASUREMENTS  FROM  MODEL  (dB) 
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DISTRIBUTION  OF 
MEASUREMENT  DEVIATIONS 
FROM  DE-BIASED  MODEL 
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FIGURE  20 


THEORETICAL  DISTRIBUTION  OF  MEASUREMENTS 
ABOUT  TRUE  SAMPLE  MEANS 


FIGURE  21 


is  the  distribution  of  sampling  error  alone;  the  difference  is  due  to  the 
presence  of  tracking  error.  The  two  are  shown  superimposed  in  figure  22. 


There  are  a  number  of  distributions  of  tracking  error  which  could 
he  added  to  the  sampling  error  to  produce  approximately  the  results  observed 
in  figure  20.  But  as  the  resultant  is  approximately  a  normal  distribution,  we 
hypothesize  that  the  model  tracking  error  is  also  normally  distributed  and 
independent  of  sampling  error.' 

figure  20,  then,  is  hypothesized  to  he  the  distribution  of  the 
sum  of  two  normally  distributed  random  variables,  for  the  suns  of  independent 
normal  random  variables  we  have  the  relation: 


cr 


7 

S~ 


or 


Where: 


°t  -V -  ^s2 

7 

■£  =  Variance  of  summed  sampling  and  tracking  errors 

_  7 

°  s"  =  Variance  of  sampling  errors 
<r  ? 

t“  =  Variance  of  tracking  errors 


l’.c  also  knowers  =  3.4S  db  and 6^ was  ailculated  to  be  4.25  dh.  (Standard  deviation  rf 
Figure  20).  Solving  t.ie  latter  equation: 


"c  havc:  (Tt  =  2.4S  db 

So  if  the  tracking  error  is  normaliv  distributed,  it  has  a  standard  deviation 
of  2.45  dh. 


In  summary ,  the  model  error,  for  descriptive  purposes,  consists 
of  two  components:  bias  error  and  tracking  error.  Hie  bias  error  increases 
with  range  from  0  at  close  range  to  8  or  9  d!>  at  100  miles.  'Hie  tracking 
error  is  superimposed  on  the  bias.  It  is  of  unknown  distribution,  but  if 
assumed  to  be  normally  distributed  it  lias  a  standard  deviation  of  2.45  db 
and  a  mean  of  zero. 

E.  INFLUENCE  Of  BOTTOM  TOl’OCUAPMY. 


1.  General. 


The  present  version  of  the  propagation  loss  model  lias  provision 
for  making  use  of  bottom  topography  data,  for  this  project,  bottom  depth  at 
half-mile  intervals  along  the  line  of  buoys  was  introduced  to  the  program. 

The  program  interpolated  linearly  between  these  points  to  construct  a 
continuous  bottom  profile.  Bottom  depth  and  slope  were  taken  from  the  linear 
segments  to  calculate  depth  of  reflection  points  and  angles  of  reflection 
from  the  bottom. 


SUPERPOSED  DISTRIBUTIONS  OF  DEVIATIONS 


FIGURE  22 


In  this  section  of  the  report,  we  consider  the  influence  of  bottom 
tonography  on  the  model  predictions,  on  the  observed  data ,  and  on  the  corre¬ 
spondence  between  the  two. 

Botcom  topography  is  one  of  the  "controlled"  variables  of  the 
experiment  and  is  controllable  in  the  model.  This  docs  not  mean  that  sane 
conceptual  bottom  profi le  can  be  arbitrarily  chosen  for  the  experiment,  but 
only  that  each  sample  consists  of  measurements  which  were  nominally  made  over 
the  same  bottom  segment  and  that  the  shape  of  this  bottom  segment  can  be 
specified  to  the  model. 

Duo  to  the  geometry  of  the  experiment,  we  have  two  sets  of  paired 
samples.  One  set  is  the  up  slope  measurements  and  one  set  down  slope.  The 
two  members  of  cacli  pair  were  made  under  conditions  which  were  identical 
except  for  tiie  bottom  profile;  oti.cr  controlled  variables  such  as  range  and 
velocity  profile  were  nominally  identical  for  both  members  of  the  pair.  Thus, 
when  differences  occur  between  members  of  a  pair,  the  difference  must  lie  due 
only  to  bottom  difference  and.  sampling  error  and  not  to  variation  of  other 
controlled  variables. 

he  note  also  that  loss  predictions  from  the  model  are  similarly 
paired,  i'.'c  have  one  curve  for  losses  up  slope,  toward  buoys  A,  B  and  C  and 
one  curve  for  down  slope  losses  to  buoys  F.  G  and  i!  and  for  <anv  range  wc 
have  two  model  predictions. 

2 .  Bottom  Topography  and  tiie  Model. 

Kb  look  first  at  what  the  model  predicts  the  influence  of  differing 
topography  will  he.  In  Figure  23  the  predictions  for  up  slope  losses  are 
superimposed  on  down  slope  loss  predictions.  Ke  see  that  the  two  curves 
correspond  quite  closely  out  to  a  range  of  about  95  miles.  To  20  miles  the 
difference  is  expected  to  he  generally  less  than  one  db  and  from  there  to  95 
miles,  the  expected  difference  is  generally  one  to  two  db.  Kc  infer  from  this 
figure  that  tiie  model  predicts  that  bottom  topography  influence  will  be  minimal 
at  near  and  medium  ranges  and  will  increase  to  some  extent  at  ranges  over  95 
miles. 


3.  Bottom  Topograpiiy  and  boss  Data. 

The  observed  loss  measurements  are  shown  in  Figure  24.  One  trace 
is  the  sample  means  in  the  up  slope  direction.  Superimposed  is  a  trace  of 
the  sample  means  down  slope.  Figure  24  contains  some  interesting,  though 
qualitative ,  features. 

First,  there  is  much  less  agreement  between  those  two  curves 
than  between  the  two  model  traces.  This  is  to  he  expected,  however ,  since 
the  sampling  error  is  included  in  the  observed  loss  curves. 

Kc  see  that  the  curves  agree  better  at  long  range  than  at  short 
range  which  is  just  the  opposite  of  what  the  model  predicts. 

Since  Figure  24  is  a  plot  of  sample  means,  it  includes  the 
sampling  error  and  some  part  of  the  observed  differences  in  the  two  curves 
is  due  to  this  factor.  The  question  thus  arises  whether  bottom  topography 
caused  any  difference  at  all  in  the  two  sets  of  measurements  or  if  the 
differences  may  be  due  entirely  to  sampling  error.  To  answer  this  question 
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kc  use  a  hypothesis  testing  procedure  similar  to  that  employed  to  compare  the 
model  to  the  sample  means. 

We  formulate  the  hypothesis:  The  two  members  of  each  sample  pair 
were  drawn  from  populations  which  have  equal  means.  If  accepted,  this 
hypothesis  would  indicate  that  there  is  no  significant  difference  between  up 
slope  and  down  slope  loss  measurements  and  that  differences  are  due  only  to 
sampling  error,  h'e  use  again  the  "t"  test  for  equality  of  means- 

I  Xj  -  x2l  <  SP  (1/NJ+  1/N2)  t*  with  *  *  .1 


Where : 


x  =  .Sample  mean  for  first  sample  of  a  pair 
=  Sample  mean  for  second  sample  of  a  pair 
Sp  =  Pooled  variance  of  231  samples 

Nj  =  Sample  size  of  first  sample 

>J7  =  Sample  size  of  second  sample 

XJ,  =  "t"  for  o(  =  .1  and  391  degrees  of  freedom 


The  test  is  applied  to  each  sample  pair  and  the  hypothesis  is  accepted  if  the 
left  hand  side  of  the  equation  is  loss  than  the  right.  Acceptance  limits  for 
various  combinations  of  N.  and  N?  arc  shown  in  Table  4. 
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3 

4 

1 

8.0  db 

2 

6.95  db 

5.69  db 

3 

6.55  db 

5.18  db 

4.54  db 

4 

6.37  db 

4.92  db 

4.05  db 

4.02  db 

ACCEPTANCE  LIMITS  FOR  MEANS  TESTS 
TABI.E  4 

The  outcome  of  these  tests  for  each  sample  pair  is  summarized  here: 


Total  pairs  tested 
Pairs  with  equal  means 
Pairs  with  unequal  means 


110 

73 

37 


Of  the  110  sample  pairs  tested,  37  were  found  to  have  unequal  means.  Recalling 
that  we  used  a  significance  level  ofo<  =  10%  we  expect  to  get  about  11  rejections 
even  if  all  pairs  really  do  have  equal  means.  However,  the  occurrence  of  37 
rejections  is  a  strong  indication  that  all  pairs  do  not  have  equal  means  and  we 
reject  the  hypothesis  that  they  do. 

We  conclude  that  some  of  the  difference  between  up  slope  and  down 
slope  measurements  is  due  to  differing  bottom  topography  and  is  not  due  entirely 
to  sampling  error. 

A  question  naturally  arises  at  this  point  concerning  how  much  of 
the  difference  observed  in  the  curves  is  due  to  differing  bottom  profiles .  And 
it  would  be  very  useful  to  separate  the  influence  of  bottom  difference  and  sampling 
error.  Unfortunately,  the  sample  sizes  arc  simply  too  small  to  separate  the 
two  effects.  We  can  say  with  certainty  that  the  two  effects  co-exist  in  the 
data,  but  that  they  cannot  be  separated  and  measured. 

4 .  fodcl  Success  with  bottom  Profi  1c. 

ivc  come  next  to  the  question  of  how  well  the  model  made  use  of  the 
bottom  topography  data,  fan  it  he  shown  that  use  of  bottom  profile  improved 
the  model  predictions? 

Since  we  arc  unable  to  say  how  much  of  the  difference  between  two 
measured  loss  curves  is  due  to  difference  in  bottom  profile,  it  appears  that 
we  cannot  determine  how  well  the  model  used  the  profile  data,  for  example, 
the  model  might  predict  a  given  difference  between  members  of  one  pair.  But 
when  we  look  at  the  observed  data  we  do  not  know  how  much  of  the  observed 
difference  is  due  to  sampling  error.  Anu  in  73  out  of  110  pairs  we  cannot  be 
certain  that  a  significant  difference  really  exists  between  members  of  the 
pair. 


Vvc  arc  able  to  obtain  one  interesting  result,  however,  by 
concentrating  on  the  37  instances  where  the  measured  losses  were  significantly 
different  for  up  slope  and  down  slope  measurements.  The  data  suggest  that, 
at  least  at  these  points,  the  bottom  caused  a  significant  difference  in 
losses,  he  see  also  that  for  these  37  pairs  the  model  also  makes  different 
prediction  for  each  member  of  the  pair.  A  comparison  of  each  of  the  measured 
loss  pairs  with  the  corresponding  model  values  shows  that  iu  24  of  the  37 
pairs  the  model  was  incorrect  in  predicting  which  member  of  the  pair  would 
show  greater  loss.  It  was  correct  ir.  13  cases. 

Similar  comparison  for  all  110  sample  pairs  show  the  model  was 
correct  53  times  and  incorrect  57  times. 

This  is  an  interesting  but  inconclusive  finding.  In  essence 
it  implies  that;  had  the  model  erroneously  mixed  the  bottom  profiles,  better 
predictions  would  have  resulted  in  this  instance,  We  do  not  suggest  that 
taking  bottom  profile  into  account  is  fruitless.  We  simply  cannot  show  that 
the  model  prediction  process  was  improved  by  using  data  on  the  minor  differences 
between  two  similar  bottom  segments. 
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IV.  INTFW’RI'l'ATION'  ANH  IMPLICATION'S 


To  this  point,  the  object  of  this  analysis  has  been  to  investigate  the 
relationship  between  the  propagation  loss  model  and  a  set  of  measurements. 
Quantitative  descriptions  of  model  and  experimental  errors  have  been  presented  . 

But  these  numerical  results  have  varying  significance  and  implications  for 
various  purposes .  We  will  make  some  general  observations  and  expect  that 
interested  parties  will  arrive  at  other  interpretations  appropriate  to  their 
own  purposes. 

Tire  analysis  describes  two  arbitrary  components  of  model  error.  We  do 
not  suggest,  however,  that  simply  adjusting  the  model  mechanically  to  reduce 
or  eliminate  these  particular  errors  is  desirable.  'Hie  model  lias  been  designed 
to  simulate  a  physical  process  and  further  refinement  should  proceed  on  the 
basis  of  research  into  the  fundamental  physical  processes  involved  and  perhaps 
into  the  stochastic  behavior  of  some  of  the  variables.  The  measurement  of 
error  is  simply  a  criterion  by  which  to  measure  progress;  the  character  of  the 
error  may  give  little  or  no  indication  of  the  source  of  error. 

The  separation  of  experimental  error  from  model  error,  however,  indicates 
potential  benefits  which  might  be  obtained  by  further  model  development. 

Figure  25  illustrates  the  distributions  of  errors  which  may  be  expected  under 
three  conditions.  First,  curve  A  indicates  the  distribution  of  combined 
sampling  and  model  error  for  single  observations.  If,  for  example,  the 
present  model  predicts  a  certain  loss  between  two  points,  a  505  chance  exists 
that  a  single  measurement  between  those  points  will  disagree  with  the  prediction 
by  5.5  d!>  or  more. 

Curve  B  represents  the  expected  errors  between  single  observations  and  a 
hypothetical  model  from  which  the  bias  has  been  removed.  This  curve  has 
physical  significance  only  if  the  model  bias  error  results  from  some  identifiable 
cause  and  can  be  removed  without  influencing  the  remainder  of  the  variables.  It 
is  shown  here  to  illustrate  the  strong  influence  of  bias  error  in  relation  to 
tracking  error. 

Curve  C  represents  the  distribution  of  errors  that  would  be  observed 
between  single  measurements  and  a  "perfect"  model,  i.c.  one  that  exactly 
represents  the  true  mean  loss  function. 

If  we  assume  that  the  model  is  used  primarily  to  predict  the  loss  in  a 
single  observation  or  in  a  number  of  observations  in  adjacent  spaces,  then  wc 
arc  interested  in  the  errors  shown  in  curve  A,  not  merely  in  the  model  error  alone. 
And  we  arc  interested  in  the  i eduction  of  total  resultant  error  (model  error 
plus  sampling  error)  which  occurs  due  to  reducing  the  model  error  component . 

Thus,  we  see  that  improvement  from  the  present  model  to  a  "perfect"  model 
will  reduce  the  total  prediction  error  by  about  one-half.  (F.rrors  in  curve  A 
are  roughly  twice  those  in  curve  C.)  l\c  also  see  that  developments  which 
eliminate  the  model  bias  produce  a  model  which  is  nearly  perfect  (curve  B) , 
and  that  failure  of  the  model  to  follow  minor  fluctuations  of  the  true  loss 
contributes  a  very  minor  error  increase.  These  observations,  based  on  partial 
and  presumptive  evidence,  arc  advanced  as  conjectures  and  not  conclusions.  So  it  is 
appropriate  to  review  here  some  of  the  limitations  of  this  analysis  and  their 
possible  influence  on  the  results.  These  are: 
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1.  The  greatest  and  most  obvious  limitation  is  the  restricted  area  and 
time  span  of  the  experiment.  These  results  are  not  necessarily  representative 
of  other  areas. 

2.  A  number  of  elements  are  grouped  together  into  the  single  category 
of  ' experimental"  or  "sampling"  error.  Kc  assume  that  the  primary  component  is 
variation  of  the  phenomenon  being  measured,  i.c.  propagation  loss;  however,  some 
components  are  undoubtedly  attributable  to  equipment,  processing,  and  incremental 
representation  of  continuous  functions.  The  influence  of  navigation  error  would 
require  considerable  investigation  if  data  were  available.  In  the  absence  of 
such  data,  however,  i-:c  observe  that  in  fev:  instances  would  shifting  single  run 
traces  a  few  miles  or.c  way  or  another  make  them  match  significantly  better. 

5.  The  statistical  tests  applied  in  Section  III-!'  (particularly  the 
tests  for  equality  of  means)  assume  that  each  sample  is  from  a  normal  population 
and  that  samples  arc  independent.  The  normalcy  of  data  «!istribution  was  accepter!, 
hut  not  proven,  by  testing  distributions,  because  the  model  was  distinctly 
biased  the  existence  of  model  error  is  not  seriously  questioned;  but  if  the  cor- 
rcsjKJndcncc  between  model  and  *!ata  had  been  better,  deeper  investigation  of  data 
distribution  would  be  necessary .  Ihc  same  caution  applies  to  the  sample  independence. 
Sample  spaces  arc  one  nile  aiiart.  (Considering  the  five  minute  averages  and  the  IS 
knot  jimjcctor  velocity,  we  find  some  overlap  from  sarnie  to  sarnie,  hut  not  enough 
to  question  the  results. 

4.  he  observed  earlier  that  reducing  the  model  error  to  zero  still  leaves  a 
significant  cxjicrinental  error  for  the  user  of  model  predictions  to  contend  with. 

Hi  is  is  true,  however,  only  so  long  as  the  cxjjcrimcntal  error  remains  the  same. 

Since  the  experimental  error  is  probably  due  largely  to  variation  of  uncontrolled 
variables,  the  obvious  means  of  reducing  it,  conceptually  at  least,  is  to  "control" 
chic  or  snore  of  the  now  uncontrolled  variables.  The  recent  introduction  of  lxjttom 
tojiography  data  into  the  model  was  an  attempt  to  cio  this.  Kc  will  not  conjecture 
here  wliat  variables  night  !ic  controlled,  eitb.er  cxjjerimcntally  or  in  tlie  model, 
but  merely  point  out  that  tiie  sampling  error  limitation  prevails  only  for  tlie 
particular  set  of  controlled  variables  now  used. 

5.  Finally,  perhaps  the  model  should  not  be  expected  to  predict  the  true  mean 
loss  at  a  point  in  space.  Father,  a  model  might  lie  configured  to  predict  the 
general  behavior  of  tlie  loss  function  over  an  interval .  This  could  conceptually 

he  more  useful  to  the  user  who  is  interested  in  intensity  integrals  over  an 
interval. 
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SUFARV  OF  I-25ULTS 


'when  a  propagation  loss  prediction,  for  a  certain  range,  is  ca^iarca  to  a 
niansurcnent  mace  at  the  same  range,  the  difference  between  the*  tv;c  is  a 
conibinntion  c»f  kotn  error  in  t.:.e  model  and  experimental  error  in  the  measure- 
ment.  -ith  the  noocl  runs  anc.  less  reasurements  used  here,  bie  canLir.ed  errors 
’-.ere  sues  bat  505-,  of  measurements  differed  by  5.5  rib  or  loss  frem  bie  monel 
and  05'L  differec  oy  13  <Jj  or  loss.  It  was  Coin  id  that  agreement  betv.cen  tne 
ncuol  ano  bie  •measurements  ’./as  significantly  totter  tit  close  range  (out  to  aoout 
•VJ  miles)  bun  at  long  ranges  (100  miles  anc-'  ever)  where  bie  model  consistently 
predicted  too  little  loss. 

Propagation  loss  measurements  were  made  at  source-receiver  ranges  of  0  to  115 
miles,  anc  the  measurements  were  related  four  times  over  biis  interval.  It  was 
found  that  successive  measurements  at  tie  sane  points  were  approximately  normally 
distributed  in  db  and  log  normal  in  intensity  ratio.  Tlie  standard  deviation  of 
bie  error  distribution  did  not  vary  significantly  witn  range,  and  was  calculated 
to  be  3.5  db. 


The  model  error  is  considered  to  be  tlie  difference  between  the  loss  value 
predicted  by  bie  model,  for  a  certain  range,  and  the  conceptual  "true1’  average 
loss  at  tlie  sane  range.  The  model  error  can  be  conveniently  describee  in  terms 
of  two  cctn-xaients;  i.c.  bias  error  and  tracking  error.  liras  error  describes 
bie  average  offset  of  the  model  over  seme  range  interval  and  tracking  error 
describes  bie  fluctuation  of  the  model  about  fne  conceptual  :'true"  value.  In 
bie  data  used  nere,  the  bias  error  was  found  to  vary  from  near  zero  at  close 
range  (0  to  40)  miles  to  about  -9  db  at  ranges  frem  75  to  115  miles.  The 
tracking  error  can  to  described  as  an  approximately  normally  distributed  random 
variable  with  a  standard  deviation  of  2.45  db  and  a  mean  of  zero. 

The  sea  bottom  under  tin  experimental  area  sloped  gently  from  cne  end  to 
the  other;  measurements  were  made  both  in  the  up  slope  arid  down  slope  directions. 
Differences  in  bie  twe  resulting  loss  curves  were  generally  obscured  by  the 
presence  of  significant  experimental  error,  and  tto  curves  differed  little. 

Tlie  model  predicted  roug.ily  ecjuivalent  losses  in  each  direction,  and  it  could 
not  be  shewn  biat  use  of  the  local  bettaa  tepograpny  by  the  model  improved  the 
predictions. 
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VI  RECOtteroKTICNS 

In  view  of  the  substantial  experimental  error  found  here,  it  is  reccmended 
that  future  propagation  loss  measurement  experiments  be  designed  to  provide 
adequate  data  concerning  experimental  error. 

At  sea  experiments  should  be  conducted  to  investigate  the  mechanisns 
contributing  to  the  experimental  error. 

The  variation  of  experimental  error  over  a  wide  area  and  over  substantial 
time  periods  should  be  investigated. 

Similar  comparisons  should  be  made  between  model  predictions  and  loss 
measurements  conducted  in  other  areas  with  different  parameters.  Ccrtparisons 
should  be  made,  for  example,  in  an  area  where  convergence  zone  propagation  is 
evident. 
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Appendix  A  contains  a  tabulation  of  measurement  data,  model  predictions  and 
calculations  arranged  by  sample.  The  results  associated  with  each  buoy  are  listed 
on  separate  pages.  A  single  line  of  figures  constitutes  the  data  pertaining  to 
one  sample  space. 

The  significance  of  the  column  headings  is  as  follows: 


COLUMN 
1  (11) 

2,3, 4,5 


6  (p7l) 

7  (f  IP) 

8  (S?) 

9  (6, 

10  (SS) 

11  (T-10) 

12  (T-l) 


The  range  between  the  projector  and  the  sonohuoy  for 
measurement  data.  'Ihe  horizontal  range  between  source  and 
receiver  for  model  data. 

The  column  headings  arc  run  identification  numbers  for  the 
VASSF.L  XV  measurements,  bach  of  the  columns  contains 
propagation  loss  measurements,  in  db,  for  a  single  projector 
nass. 


Average  propagation  loss.  The  arithmetic  average  of  the 
individual  measurements  in  that  sample. 


Propagation  loss  predicted  by  the  model  for  that  sample. 
Variance  of  measurements  in  that  sample. 

Deviation,  in  db,  between  sample  mean  and  model  prediction. 


Sample  size  (number  of  measurements  in  the  sample). 

Indicates  whether  model  value  was  accepted  (0)  or  rejected 
(R)  as  the  true  mean  of  that  sample  at  the  10%  level  of 
signi ficance 


Indicates  whether  model  value  was  accepted  (0)  or  rejected 
(P.)  as  the  true  mean  of  that  sample  at  the  1%  level  of 
significance. 
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